Skip to content

[format] Introduce support for Parquet byte stream split encoding - #9359

Merged
JingsongLi merged 1 commit into
apache:masterfrom
ArnavBalyan:arnavb/add-bss
Aug 23, 2026
Merged

[format] Introduce support for Parquet byte stream split encoding#9359
JingsongLi merged 1 commit into
apache:masterfrom
ArnavBalyan:arnavb/add-bss

Conversation

@ArnavBalyan

Copy link
Copy Markdown
Member

Purpose

  • Paimon’s vectorized reader does not support byte stream split encoding, as a result reading bss file fails.
  • Add vectorized decoding that loads the encoded page and reconstructs by gathering the various byte streams.
  • Supports vectorized reads for int double, long and flb values.

Tests

  • UT

@ArnavBalyan

Copy link
Copy Markdown
Member Author

cc @JingsongLi thanks! :)

@JingsongLi JingsongLi left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1

@JingsongLi
JingsongLi merged commit 83b2eec into apache:master Aug 23, 2026
11 of 13 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants